I created a new pull request for DMR.
This adds Docker Compose file preconfigured for Docker Model Runner (DMR). The YAML includes direct links to official Docker documentation to guide users through installing and enabling the docker-model-plugin, making it easier to run AI models locally using an OpenAI-compatible API.
The configuration uses the lightweight ai/qwen3:0.6B-Q4_0 model (~500 MB), chosen for its small resource footprint, ability to run on integrated graphics, and surprisingly reliable performance—ideal for testing or low-power systems.
From my personal experience, a tmpfs mount for /app/temp_audio is far better that docker volume in this case; ensuring temporary audio files stay entirely in RAM. This significantly reduces disk I/O and improves workflow responsiveness, and is safe given the small size of typical audio snippets. I don't think audio files can be larger than 1gb.
Finally, the README.md has been updated to reference the new DMR-enabled Docker Compose file, helping users easily discover and enable the local model runner setup.

I tried DMR with the Open AI integration and I am getting this error using Instant Playlist:

--- Attempt 1 of 3 ---
Processing with OPENAI model: ai/qwen3:0.6B-Q4_0 (at http://172.17.0.1:12434/engines/llama.cpp/v1/chat/completions).
OpenAI API Error: Error: AI service is currently unavailable.

--- Attempt 2 of 3 ---
Retrying due to previous issue: Error: AI service is currently unavailable.
Processing with OPENAI model: ai/qwen3:0.6B-Q4_0 (at http://172.17.0.1:12434/engines/llama.cpp/v1/chat/completions).
OpenAI API Error: Error: AI service is currently unavailable.

--- Attempt 3 of 3 ---
Retrying due to previous issue: Error: AI service is currently unavailable.
Processing with OPENAI model: ai/qwen3:0.6B-Q4_0 (at http://172.17.0.1:12434/engines/llama.cpp/v1/chat/completions).
OpenAI API Error: Error: AI service is currently unavailable.

Failed to generate and execute a valid query that returns results after 3 attempt(s). Last issue: Error: AI service is currently unavailable.

Logs had this to say:

audiomuse-ai-flask-app | [ERROR]-[19-11-2025 20-09-19]-An unexpected error occurred in get_openai_compatible_playlist_name
audiomuse-ai-flask-app | Traceback (most recent call last):
audiomuse-ai-flask-app | File "/app/ai.py", line 146, in get_openai_compatible_playlist_name
audiomuse-ai-flask-app | full_raw_response_content += choice['delta']['content']
audiomuse-ai-flask-app | TypeError: can only concatenate str (not "NoneType") to str

Using the configurations I added to Docker compose and bashing into the container to run this I was able to get an answer from DMR:

root@4fc6ef2cbdad:/workspace# curl -X POST "http://172.17.0.1:12434/engines/llama.cpp/v1/chat/completions" \0.1:12434/engines/llama.cpp/v1/chat/completions" \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer test-api-key" \
  -d '{
        "model": "ai/qwen3:0.6B-Q4_0",
        "messages": [
          { "role": "user", "content": "say hi" }
        ],
        "stream": false
      }'
{"choices":[{"finish_reason":"stop","index":0,"message":{"role":"assistant","reasoning_content":"Okay, the user said \"say hi\". I need to respond to that. Since the user is probably trying to say hello, I should respond with a friendly greeting. Let me make sure to keep it simple and cheerful. Maybe say \"Hi there!\" to keep the conversation going. That should be good enough.","content":"Hi there! 😊  How can I help you today?"}}],"created":1763583884,"model":"ai/qwen3:0.6B-Q4_0","system_fingerprint":"b1-c22473b","object":"chat.completion","usage":{"completion_tokens":80,"prompt_tokens":10,"total_tokens":90},"id":"chatcmpl-YaO3BTmXLv1Nsp1kDjXounLq8a8KLHch","timings":{"cache_n":0,"prompt_n":10,"prompt_ms":740.572,"prompt_per_token_ms":74.0572,"prompt_per_second":13.503076000712962,"predicted_n":80,"predicted_ms":11300.522,"predicted_per_token_ms":141.256525,"predicted_per_second":7.07931

I tested the function under ai.py and this was the output:

DEBUG:llm-test:POST http://172.17.0.1:12434/engines/llama.cpp/v1/chat/completions
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): 172.17.0.1:12434
DEBUG:urllib3.connectionpool:http://172.17.0.1:12434 "POST /engines/llama.cpp/v1/chat/completions HTTP/1.1" 200 None
LLM Response:
Error: can only concatenate str (not "NoneType") to str

I am not sure if it is timing out or simply not extracting correctly.